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^ ; 1 Introduction and summary 
(N 

Suppose that SI C RP and that fj, is a c-finite measure on 0. Consider a si x S2 complex matrix 
g : function N(y, ,) on n x n. Generally we shall assume that iV e L 2 („ x „) and is uou-trivial, that 



Abstract: We give the Jordan form and the Singular Value Decomposition for an integral operator 
J\f with a non-symmetric kernel N(y,z). This is used to give solutions of Fredholm equations for 
non-symmetric kernels, and to determine the behaviour of M n and (J\fJ\f*) n for large n. 



is, 

|2 / / II » r /„ _\||2 



0<||JV||2 = J J \\N(y,z)\\ 2 d»(y)d(,(z) < oo. 
The integral operator asociated with (N, fj,) is AA defined by 

Mq{y) = [ N(y,z)q(z)dfi(z), p(z)*M = [ p(y)* N(y, z)d l x(y) (1.1) 



where p : O — ► C Sl and g : SI — > C S2 are any functions for which these integrals exist, for example 
p,q G Lz^fji), that is J \p\ 2 dfi < oo, and similarly for q. (All integrals are over SI. * denotes the 
transpose of the complex conjugate.) 

Section 2 reviews Fredholm theory for Hermitian kernels, that is, when N(y,z)* = N(z,y), so 
that si = S2 ■ For this case, Af n = 0(r") for large n where r\ is the magnitude of the largest 
eigenvalue. 

Section 3 extends this to non-Hermitian kernels for the case of diagonal Jordan form. Again 
M n = (9(r™) for large n for n as before. 

Section 4 deals with the case of non-diagonal Jordan form. In this case N n = 0(r™n M_1 ) for 
large n for n as before where M is the largest multiplicity of those eigenvalues with modulus r\. 
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Section 5 gives the Singular Value Decomposition (SVD) for a non-symmetric kernel N(y,z). 
In this case one has results such as {MM*) n = 0{9 2n ) for large n where 9\ is the largest singular 
value.. 

2 Hermit ian kernels 

Matrix theory 

First consider a Hermitian matrix N* = N G C sxs . Its eigenvalues ui,--- ,is s are the roots of 
det(iV — vl) = 0. They are real. Corresponding to Uj is an eigenvector pj satisfying Npj = VjPj- 
These are orthonormal: PjPk = 8jk where Sjj = 1 and Sjk = for j ^ k. Set P = (p\, ■ ■ ■ ,p s )- If 
N and its eigenvalues are real, then P can be taken to be real. The spectral decomposition of N in 
terms of its eigenvalues and eigenvectors is 

s 

N = PAP* = ^2 VjPjPj where A = diag(>i, • • • , u s ), (2.1) 

s 

Y, "ii'jio = pp * = h = p*p = (p*Pk). 

0=1 

So for a G C 

s 

N a = pA a p * = uf PjP *, (2.2) 

provided that if det(iV) = 0, then a has non- negative real part. So for det(iV) ^ 0, 

s 

Nf = g=>f = N-'g = £ vfp^g). 

3=1 

Similarly for v not an eigenvalue and /, g € C s , 

s 

(uI-N)f = g^f = [yl - N)~ 1 g = - u^p^g). 

i=i 

For large n, if 

t\ = Wi\ = • • • = \um\ > ro = max \uA (2.3) 

j=M+l 

then 

M 

N n = r\C n + 0(rff) where C n = ^[sign (u^pjp* = O(l) (2.4) 

i=i 

assuming that s does not depend on n. 
Function theory 

Now consider a function N(y,z) : Q 2 — > C sxs and a cr-finite measure [i on Q C R p . Its integral 
operator with respect to /U is J\f defined by (jl.ip . Suppose that the kernel N is Hermitian, that is, 

N(y,z) m =N(z,y). 
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Then the analogues of the matrix results above are as follows. Suppose that ||A/"||| > and 

J \Njj(x, x)dfi(x) < oo. 

The spectral decomposition of N in terms of its eigenvalues and vector eigenfunctions { P j(y)} : O — » 
C s , is 

oo 

7V(y,z) = P(y)AP(z)* = J2^jPMP^T ( 2 -5) 
whereA = diag(vi,v 2 , ■ ■ ■), P(y) = (pi(y),p 2 (y), ■ ■ ■)■ 
The eigenfunctions are orthonormal with respect to /u: 

J P*jPkdfi = S jk . 

In Fredholm theory the convention is to call {Xj = vj 1 } the eigenvalues, rather than {vj}. 

= P(y)P( z )* is generally divergent but can be thought of as a generalized Dirac function: 
fl yz f(z)dfi(z) = f(y). P(z)*P(y) = ( Pj (z)* Pk (y)) satisfies / P{z)*P{z)dn{z) = 

For n = 1, 2, • • • , N n (y, z) = M n ~ x N(y, z) satisfies 

s 

N n (y,z) = P{y)K n P{z)* = J>>i • 

3=1 

For large n, if (|2.3p holds then 

M 

N n (y,z) = r?C n (y,z) + 0(rJ) where C„(y,z) = J>ign (z, i )]> i (y)p i (z)* = 0(1). 

i=i 

Conditions for (|2,5|) to hold pointwise and uniformly are given in Withers (1974, 1975, 1978.) It is 
known as Mercer's Theorem. 

The resolvent 

Given functions f,g:£l^C s , the Fredholm integral equation of the second kind, 

p(y)-\Mp{y) = f(y), (2.6) 
can be solved for A not an eigenvalue using 

(J - AAfT 1 = 1 + W A , that is, J\f\ = (I - \N)~ 1 N 

where 



W(y)= I N x (y,z)f(z)dv(z), g{z)N x = J g(y)N x (y,z)d^(y), 
and the resolvent of Af, 

N x (y, z) = (I- XMy'Niy, z) : C x ft 2 -> C sxs 
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with operator j\f\ is the unique solution of 

(/ - XAf)N x = N = N X (I - AW), 

that is, 

XAfN x (y, z) = N(y, z) - N x (y, z) = \N x (y, z)N . 

If this can be solved analytically or numerically, then one has a solution of (|2.6p without the need 
to compute the eigenvalues and eigenfunctions of M. 

The resolvent satisfies 

N x (y,z) = Y,PMPj(zy/^i ~ (2-7) 

3=1 

Conditions for this to hold are given by Corollary 3 of Withers (1975). The Fredholm equation of 
the second kind, (12.61). has solution 



oo „ 

p(y) = f(y) + A J>,-(iO J P *fd^/{\ 3 - A). 



3=1 

The resolvent exists except for A = Xj, an eigenvalue. The eigenvalues of M are the zeros of its 
Fredholm determinant 

D(\) = n^(l - X/Xj) = exp{- J dX j trace N x (x, x)dfi(x)}. (2.8) 

The Fredholm integral equation of the first kind 

XAfp(x) = p(x) 

has a solution provided that A is an eigenvalue. For v an eigenvalue, its general solution p(x) is a 
linear combination of the eigenfunctions {pj(x)} corresponding to Xj = X. 

Example 2.1 Suppose that Y, Z € R and (^) ~ A/2(0, V) where 

V = (I jY So V is the 

correlation matrix for (^). For j E N+, x G R set Pj{x) = Hj{x)/j\ 1 ^ 2 where Hj(x) is the 
standard univariate Hermite polynomial. Then J pjPk4>i = Sjk and 

oo 

Z^rJpj^pjiz) = 4>c{y,z)/4>i{y)ct>i(z). 

3=0 

This is Mehler's expansion for the standard bivariate normal distribution. Pearson gave an in- 
tegrated version and Kibble extended it to an expansion for <j)y{x) / (f>j{x) for x € R k and V a 
correlation matrix. See for example (45.52) pl27 and p321-2 of Kotz, Balakrishnan and Johnson 
(2000). 
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3 Functions of two variables with diagonal Jordan form 



Diagonal Jordan form for matrices 

Consider N G C sxs with eigenvalues v\, ■ ■ ■ ,u s , the roots of det(iV — vl) = 0. N is said to have 
diagonal Jordan form (DJF) if 

TV = PAQ* where PQ* = I and A = diag(i^, • • • ,v s ). 

So 

s 

N = ^2 VjPjq*, q*Pk = $jk where P = (pi, ■ • • ,p s ), Q = (q u ■ ■ ■ , q s ), 

s 

= PQ*=Is = Q*P=(q*Pk)- 

3=1 

If N, A are real then P, Q can be taken as real. Also 

NP = PA, N Pj = Vjpj, N*Q = QA, N*qj = Vjqj, (3.1) 
and for any complex a, 

s 

N a = PA a Q* = ^2 v fPj1*j 

3=1 

provided that if det(iV) = 0, then a has non-negative real part. Suppose that 

Uj = rje %6j and r\ = ■ ■ ■ = tr > tq = mjpc r j- (3-2) 

Then 

R 

N n = r n x C n + O(rS) where C n = e in ^ Pj q* = 0(1) (3.3) 

3=1 

Taking a = — 1 gives the inverse of TV when this exists. 

Diagonal Jordan form for functions 

Now consider a function N(y,z) : Q 2 — > C sxs . When N has diagonal Jordan form (for example 
when its eigenvalues are all different), then the Fredholm equations of the first kind, 

\Np{y) =p(y), \M*q{z) = q(z), 

or equivalently for v = A -1 , 

Mp{y) = vp{y), N*q(z) = vq{z), 

also have only a countable number of solutions, say {Xj = vj l ,pj(y), qj(z), j > 1} up to arbitrary 
constant multipliers for {pj(y), j > 1}, satisfying the hi- orthogonal conditions 

J q*jPkdn = 5 jk . 
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These are called the eigenvalues and right and left eigenf unctions of (A, fi) or M. Also 

oo 

N(y,z) = Yj V oPMlj^T =P(y)AQ(zY (3.4) 

3=1 

where A = diag(z^i, u 2 , ■ ■ • ), P{y) = (pi(y),P2(y), • • • ), Q(^) = (qi(y), Q2(y), • • • )• 

with convergence in L 2 {n X /i), or pointwise and uniform under stronger conditions. If A is a real 
function and A is real, then P, Q can be taken as real functions 

For n > 1, 

N n (y,z) =AT n - 1 N(y,z) (3.5) 

satisfies 

oo 

N n ( y ,z) = J2»jPMqj(zy = P(y)A- n Q(zy, (3-6) 

oo „ 

i=i J 

If (1321) holds then 

R 

N n (y,z) = r?C n + 0(r%) where C n = Je^p^y^W* = 0(1) (3.7) 

i=i 

« 

N n p{y) = rlcn + 0(r£) where c n = £ e^^(y) / = 0(1). 

3=1 J 

The resolvent satisfies the equations of Section 2 except that (|2.7p is replaced by 

oo 

N\(y, z) = ^pMqjizT/iXj - A). (3.8) 
i=i 

The Fredholm determinant is again given by (|2.8|) . If only a finite number of eigenvalues are non- 
zero, the kernel N(y, z) is said to be degenerate. (For example this holds if \i puts weight only at 
n points.) If R = 1, that is, 

|Ai| < \Xj\ for j > 1, (3.9) 

then as n — > oo, 

AA n+1 /(y)/A^"/(y) - Ar 1 , f(yW n+1 /f(y)M n - Ar 1 . 

This is one way to obtain the first eigenvalue Ai arbitrarily closely. Another is to use 

A" 1 = sup{ J gMhdfj, : J ghdfi = 1} if Ai > 0, (3.10) 
X- 1 = inf{ J gAfhdfi : J ghdfj, = 1} if A x < 0. (3.11) 
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The maximising/minimising functions are the first eigenfunctions g = g±, h = h%. These are unique 
up to a constant multiplier if (|3.9p holds. If Ai is known, one can use 



(AiA0 n /(y)^Pi(2/) J QlfdfM, f(y)*(\iM) n ^qi(y) J f*Pid», 

for any function / : — > C s , to approximate pi(y) , qi(y) ■ One may now repeat the procedure on 
the operator Mi corresponding to 

Ni(y,z) = N(y,z) - vipi(y)qi(z)* 

to approximate \2,P2(y), 92(2) assuming that the next eigenvalue in magnitude, A2, has multiplicity 
1. 

For further details see Withers (1974, 1975, 1978) and references. 

4 Predholm theory for non-diagonal Jordan form 

Non-diagonal Jordan form for matrices 

For N 7^ N* a matrix in C sxs , its general Jordan form is 



N 


= PJP' 1 where J 


= diag(J\, ■ 


1 Jr): Jj — ^mji^j 






( X 


1 ••• 






<^m(A) 







A 1 ••• 







— A/ m + U m — 










••• 







3=1 



(4.1) 



for some matrix P, and U m is the m x m matrix with Is on the superdiagonal and Os elsewhere: 

(U m )jk = dj,k-l- 

(See [1] for example. If N and its eigenvalues are real, then P can be taken as real.) So for n > 1, 

N n = pjnp-l where jn = diag (jn ^ . . . , J"). 

By the Binomial Theorem, 



J m (Ar = £(")A n -°C£ and (U« 



a=0 

So U™ = 0. For example 

(\n „ \n— 1 
A" 

So iV™ can be expanded in block matrix form 

r 
c=l 
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where we partition P and its inverse as 

P=(P jk : j,k = l,--- ,r), p- l = {P* k : j,k = l,-- 

with elements Pj k and P^ k matrices in (7 m J xm fc. 
Alternatively setting 

Q* =P-\ (P l5 --- ,P r )=P, (Ql,"-- ,Qr)=Q, 

with Pj,Qj G C sxm ^, we have 



N n = PJ n Q* = Y,PjJ?Qj, (4-2) 



r 

J2 p jQj = PQ* = i s = Q*P = (Q*P k ) 

i=i 

so that 

Q*^ = / m ., Q*P k = G C^ xmfc if j + k. 
P can be obtained as follows. Let pj k be the kth column of Pj for k = 1, • • • , to,,-. Then 

iVP = PJ => iVPj = J,- 2Vpj fe = XjPjk+Pj,k-i where pj = 0. (4.3) 

So one first obtains pj\, the right eigenvector of N, then pj2, ■ ■ ■ ,Pj mj - This is called the Jordan 
chain. Q can either be obtained by inverting P or using 

N*Q = QJ* N*Qj = QjJ* N*q jk = X jqjk + q j>k+1 where q jtmj +l = 0. (4.4) 

So one first computes qj mj , the right eigenvector of N* then qj jm .-\, ■ ■ ■ ,qj\. For large n and 
A/0, 

Jn(\T=( n _^\ n - m+1 [U%- 1 + 0(l)] 

and U™~ 1 is a matrix of 0's except for a 1 in its upper right corner. So if (|3.2p holds and 

R 

mi = • • • = niM > max m,-, 

j=M+l 



then 



= (/_i) r r J ' +1 [A,+o(n- 1 )] 

M M 
where D n = J] P ic S n - M+1 ^U^~ l P ck = ]T P/ c e ^-M+l)e aU M-i p ck = 



c=l c=l 
See Withers and Nadarajah (2008) for more details. 

Non-diagonal Jordan form for functions 

Now consider iV : Q 2 — > C sxs . Suppose that n, is a cr-finite measure on f2 and that N is not 
Hermitian, that is N(y,z)* ^ N(z,y). Its Jordan form is 

N(y,z) =P(y)JP(z)~ 1 = where J = diag{J lt J 2 , ••• ), Jj = ^(A,) (4.5) 



for P(y) : Q, -> C sxoc and J m (A) of (|4TTJ) above. So partitioning 

P(y) = (P jk (y) : j, fc = 1,2, • • • ), P(z)" 1 = (P^ k (z) : j, fc = 1, 2, • • • ), 

with elements Pj k (y) and Pi k (z) matrix functions in — > (J mjXmk , we can partition the nth 
iterated kernel, N n (y,z) = N n ~ 1 N(y,z) as 

oo 

[7V n (y,^ = ^P ic (y) J"P cfc (z). 

Alternatively setting 

Q(z)* =P(z)" 1 , (P 1 (y),P 2 (y),---) = P(y), (Q 1 (z),Q 2 (z), ■ ■ •) = Q(z), 
with P j (y),Q j (z) : Ft -» C sxm ^, we have 

oo 

iV n (y,z) = P(y)J n Q(z)*=^Pi(y)^ n Qi(^)*- (4-6) 

i=i 

P(y) can be obtained as follows. Let Pj k (y) be the /cth column of Pj(y) for fe = 1, • • • , m.j. Then 

MP(y) = P(y)J => MP 3 (y) = Pj(y)Jj =► Afyjfc(y) = A iPj - fc (y) +p i>fc -i(y) (4.7) 

where Pjo(y) = 0. So one first obtains Pji(y), the right eigenfunction of N, then Pj2{y), • • • ,Pj mj (y)- 
Q(z) can either be obtained by inverting P(z) or using 

M*Q(z) = Q(z)J* => ATQ^) = Qj(z)Jj => M*q 3k {z) = \ 3 q jk {z) + qr^+iC*) (4.8) 

where q^m^i {%) = 0. So one first computes g^m^ (2) , the right eigenfunction of N* then q^ m ._i {£) , • • • , q 3 \ (z) 

So if (El holds and 



mi = • • • = m,M > max m,-. 

j=Af+l 



then 



(NnM)jk = [ M _ 1 jr n 1 - M+1 (D jkn (y^)+0(n~ 1 )) 

M 

where D jkn (y,z) = ^^^(#^(^=0(1) 

c=l 

has (a, b) element e i ("- M + 1 )^[P jc (y)] ol [P cfe (^)] M6 . 
Example 4.1 

5 The SVD for functions of two variables 

The SVD for matrices 

Suppose that N G (7 s i>< s 2_ Th a t is, TV is a si x s 2 complex matrix. Denote its complex conjugate 
transpose by N*. Its SVD is 

r 

N = PDQ* = e jPj<fj where pp * = J > QQ* =1, r = min(si, s 2 ), (5.1) 

3=1 

P = (pv,p Sl )GC SlXSl ,Q = (9ir-,? S2 )eC S2XS2 ,0 1 >...>9 r >O 
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and for s\ = S2, s\ > S2, s\ < S2 



D ■ ■ A. ( g )- (A.O) respect ivdy where A diag( u \ . ■ ■ ■ . </,. 1 



If N is real, then so are P and Q. 
So for si > S2, 



DD* = f ^ °V = A 2 

7' 



and for s\ < S2, 

/A 2 D 

DD* = A 2 , D*D = 

V 

Compare this with f)3. 1 [) . Also for 1 < j < r, 

iV^- = jPjj N*pj = Ojqj, 

for r < j < s\, Nqj = 0, and for r < j < S2, N*pj = 0. Also since 

NN*P = PDD*, N*NQ = QD*D, 

the pj is a right eigenvector of NN* with eigenvalue # 2 (or if r < j < s\) and the qj is a right 
eigenvector of N*N with eigenvalue # 2 (or if r < j < 82)- So (or by Section 2), 

r r 

(NN*) n = ^BfPjPi, (N*Nr = ^29] n q jq * for n>l, 

3=1 3=1 
t r 

(NN*) n N = Yj 6 ? l+lp i q h {N*N) n N* = ^0f +1 qjP) for n > 0. (5.2) 
j=i " i=i 

These do not depend on the vectors {pj, qj,j > r}. 

So if Q\ = • • • = 6m > 9m+1, then we have the approximations for n > 0, 

At At 
(NN*) n = ^^^+0(^ +1 ), (iV*iVr = ^^^* + 0(^ +1 )forn>l, 
i=i i=i 

r r 

(AW*)" AT = 0? n+1 + O^M+i 1 )- (N*N) n N* = 0T +1 E ^* + ( 5 - 3 ) 

i=i i=i 



But 



si s 2 



I si = (NN*)° = Y^PjPl = (N*N)° =Y,Wl 
i=i i=i 
If Sx = S2 and AT is non-singular, its inverse is 

AT- 1 = QA -1 P*. 

However unlike Jordan form, the SVD does not give a nice form for powers of AT. 

Now suppose f2 C R p and that \i is a c-finite measure on Q. Consider a function AT(y, z) : Q 2 
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The equations 

Mq(y)=9p(y), M*p(z)=9q(z), 
have a countable number of solutions, say {8j,pj(y),qj(z), j > 1} satisfying 

p*Pkdp = / q*qkdfi = 5 jk . 



The singular values {9j} may be taken as real, non-negative and non-increasing. (For convenience 
we have included 9j = 0.) {pj(y)} and {qj(y)} are the right eigenfunctions of MM* and M*M 
respectively, with eigenvalues Also in L2^p x fi) 

oo 

N(y,z)=Y i e j p j (y)q j {z)*. (5.4) 
If iV is real, then so are {pj, qj}. By (|5.4I ). for n > 0, 

oo 

3=1 

oo 
oo 

M*(MM*) n N(y, z) = ^f^M^T, 



i=i 



M(M*Af) n N(y,zr = ^f^^y)* 

i=i 



{MM*) n p(y) = ^9] n Pj (y) p*pdfx, 

3=1 

oo „ 

(J^Af) n q(z) = ^e^qjiz) I q*qd», 
3=1 

oo „ 

(MM*) n M q(y) = Y. d T +1 Poiv) j q]qdn, 

3=1 

oo „ 

(M*M) n M*p(y) = ^2o] n+1 Qj(y) Pjpdv, 

3=1 J 

trace M* (MM*) n N(y, z)\ z=y dfi(y) = J trace M(M*M) n N(y, z)\ z=y dfi(y) = ^9 
So if 9\ = ■ ■ ■ = 9m > 9m+i, then we have approximations such as 



oo 

2n+2 
3 

3=1 



(MM*) n p(y) = X>;(y) / PjPdfi + 0{9% +l ) 

3=1 

if Pj{y) J Pjpdp = 0(1) for j > M. So for iterations of M*M or MM* the most important parameter 
is the largest singular value. 
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